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CN| ' This paper investigates the (conditional) quasi-Iikelihood ratio 

test for the threshold in MA models. Under the hypothesis of no 
threshold, it is shown that the test statistic converges weakly to a 
function of the centred Gaussian process. Under local alternatives, it 
is shown that this test has nontrivial asymptotic power. The results 



00 



' are based on a new weak convergence of a linear marked empirical 



O 



process, which is independently of interest. This paper also gives an 
invertible expansion of the threshold MA models. 



1. Introduction. Since Tong [30], threshold autoregressive (TAR) mod- 
^ ' els have become a standard class of nonlinear time series models. Some 

. fundamental results on the probabilistic structure of this class were given 

by Chan, Petruccelli, Tong and Woolford [11], Chan and Tong [12] and Tong 

■ [31]. The 1990s saw many more contributions including, for example, Chen 
O '. and Tsay [15], Brockwell, Liu and Tweedie [6], Liu and Susko [27], An and 
^ I Huang [3], An and Chen [1], Liu, Li and Li [26], Ling [23] and others. 

The likelihood ratio (LR) test for the threshold in AR models was studied 
by Chan [8, 9] and Chan and Tong [13]. Tsay [33, 34] proposed some methods 
' for testing the threshold in AR and multivariate models. Lagrange multi- 

plier tests were studied by Wong and Li [35, 36] for (double) TAR-ARCH 
models. The Wald test was studied by Hansen [17] for TAR models. Testing 

■ the threshold in nonstationary AR models was investigated by Caner and 
, Hansen [7] . The asymptotic theory on the estimated threshold parameter in 
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TAR models was established by Chan [10] and Chan and Tsay [14] . Recently, 
Chan's result was extended to non-Gaussian error TAR models by Qian [28]; 
see also [20] for threshold regression models. Hansen [18] obtained a new lim- 
iting distribution for TAR models with changing parameters; see also [19]. 

However, almost all the research in this area to date has been limited to 
the AR or AR-type models. Except for Brockwell, Liu and Tweedie [6], Liu 
and Susko [27], de Gooijer [16] and Ling [23], it seems that threshold moving 
average (TMA) models have not attracted much attention in the literature. 
It is well known that, in the linear case, MA models are as important as 
the AR models. In particular, for many economic data, such as monthly ex- 
change rates, IBM stock market prices and weekly spot rates of the British 
pound, the models selected in the literature are often MA or ARMA models 
from the point of view of parsimony; see, for example, [32]. Now, the con- 
cept of threshold has been recognized as an important idea for time series 
modeling. Therefore, it is natural to introduce this concept in the context 
of MA modeling leading to the TMA models. Again, model parsimony is of- 
ten an important consideration in nonlinear time series modeling. We shall 
give an example of this in Section 4. In addition, techniques developed for 
TMA models should prepare us for a systematic study of the much more 
challenging threshold ARMA models. We shall give one such instance in the 
Appendix. 

We investigate the quasi-LR test for threshold in MA models. Under the 
hypothesis of no threshold, it is shown that the test statistic converges 
weakly to a function of a centred Gaussian process. Under local alterna- 
tives, it is shown that this test has nontrivial asymptotic power. The results 
heavily depend on a linear marked empirical process. This type of empirical 
process has been found to be very useful and was investigated by An and 
Cheng [2], Chan [10], Stute [29], Koul and Stute [22], Hansen [18] and Ling 
[24] for various purposes. However, all the processes in these papers have 
only one marker. To the best of our knowledge, our linear marked empirical 
process which includes infinitely many markers has never appeared in the 
statistical literature before. This is of independent interest. This paper also 
gives an invertible expansion of the TMA models. 

This paper proceeds as follows. Section 2 gives the quasi-LR test and its 
null asymptotic distribution. Section 3 studies the asymptotic power under 
local alternatives. Some simulation results and one real example are given 
in Section 4. Sections 5 and 6 present the proofs of the results stated in 
Section 2. 

2. Quasi-LR test and its asymptotics. The time series {yt:t = 0, ±1, 
±2, . . .} is said to follow a TMA{p,q,d) model if it satisfies the equation 

p q 

(2.1) yt = Yl ^i^t-i + XI i^iHvt-d < r)et-i + St, 

1=1 1=1 
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where {et} is a sequence of independent and identically distributed (i.i.d.) 
random variables with mean zero and variance < < oo, p,q,d are known 
positive integers with p> q, I is the indicator function and r € R is called 
the threshold parameter. Let G and be compact subsets of and R'^, 
respectively, and Qi = Q x be the parameter space. Let (f) = {cpi, . . . , cpp)' , 
tp = (tpi, . . . , ipq)' and A = ((/>', ip')' ■ Here A is the unknown parameter (vector) 
and its true value is Aq = {(pQjtpQ)'. Assume Aq is an interior point in Gi. 

Given observations yi, . . . ,y„ from model (2.1), we consider the hypothe- 
ses 

Hq : ■00 = versus Hi yipQ^O and some r £ R. 

Under Hq, the true model (2.1) reduces to the usual linear MA model and 
{Ut} is always strictly stationary and ergodic. In this case, the parameter r is 
absent, which renders the problem nonstandard. Under Hi, Liu and Susku 
[27] and Ling [23] showed that there is always a strictly stationary solution 
{yt} to the model (2.1) without any restriction on Aq. Under Hq and Hi, 
the corresponding quasi-log-likelihood functions based on {y„,y„_i, . . .} are, 
respectively, 

n n 

Lon{(l}) = Y.ef{(l)) and Li„(A,r) = ^e^^^^^)^ 
t=i t=i 
where £<((/>) = et(A, — oo) and 

p q 
et{X,r) = yt-^ct)iet-i{X,r) - ^ipiliyt^a <r)et^i{X,r), 

1=1 i=l 

which is the residual from the TMA model. To make it meaningful, we need 
to study the invertibility of this model. Assumption 2.1 below is a condition 
for this. 

Assumption 2.1. J^Li \ < ^ ^^'^ E?=i \ 4>i + i^i\ <'^, where ipi = for 
i> q. 

This assumption is similar to Lemma 3.1 for the ergodicity of TAR models 
in [12]. We discuss the invertibility of a general TMA model in the Appendix. 

Since there are only n observations, we need the initial values ys, when 
s < 0, to calculate et((^) and et{X, r). For simplicity, we assume ys = for s < 
0. We denote et{(j)) and et{X,r), calculated with these initial values by et{(j)) 
and et{X,r), and modify the corresponding quasi-log-likelihood functions, 
respectively, to 



n n 

Lon{(t>) ='^£f{(t>) and Li„(A, r) = ^ (A, r). 
t=i t=i 
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Let = argmine Lon(0) and A„(r) = argminei Lin(A,r). We call (j)n and 
A„(r) the conditional least squares estimators of 4)q and Aq, respectively. 
Given r, the quasi-LR test statistic for Hq against Hi is defined as 

LRn{r) = -2[LinCXn{r),r) - Zon(0n)]- 

Since the^ threshold parameter r is unknown, a natural test statistic is 
sup^g^ Z/i2„(r). However, this test statistic diverges to infinity in proba- 
bility; see (2.2) below and [4]. We consider the supremum of LRn{r) on the 
finite interval [a,b], 

LRn = sup LRn{r), 

'-^n r£[a,b] 

where a"^ = LQn{4>n) /n. This method is used by Chan [8] and Chan and 
Tong [13]. The idea here is similar to the problem of testing change points 
in Andrews [4], which has been commonly used in the literature. To study 
its asymptotics, we need another assumption which is a mild technical con- 
dition. 

Assumption 2.2. et has a continuous and positive density on R and 
Eei < oo. 

We further introduce the following notation: 

Uu{X, r) = det{\ r)/dcl), U2t{\, r) = det{\, r)/d^, 

DitiX,r) = Uu{X,r)etiX,r), D2t{\r) = U2t{X,r)et{\r), 

Ut{\r) = [U[,{\r),U'^^{\r)]' and Dt{\r) = [D[,{\r),D'^^{\r)]' . 

Throughout this paper, all the expectations are computed under Hq. We 
denote 'Lrs = E[U2t{Xo,r)U!2t{XQ,s)], Si^ = (Aq, r)f/^^(Ao, r)] and Vlr = 
£;[C/t(Ao,r)C//(Ao,r)]. Let S = £;{[5et(0o)/5(/>][(9et((/>o)/50]'}. Here and in the 
sequel, Op(l) denotes convergence to zero in probability as n — > oo. We first 
state one basic lemma, which gives a uniform expansion of LRn{r) on [a,b]. 

Lemma 2.1. If Assumptions 2.1 and 2.2 hold, then under Hq it follows 
that: 

(a) sup ||A„(r) - Aoll = Op(l), 

re[a,b] 



(b) sup 



\/^[A„(r)-Ao] + ^EA(^o,^ 



Op(l), 



(c) sup ||M„(r)-r;(r)[S„-S;,S-iSi,]-iT„(r)||=Op(l), 

re[a,b] 

where Tnir) = n-'/^ Et=i[D2t{Xo,r) - ^[,J:-'Du{XQ,r)]. 
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The proof of this lemma is quite comphcated and is given in Section 
6. Under Hq, Dit{Xo,r) = et det{(j)o) / d(j) and, by (6.4), L'2t(Ao,?') has the 
expansion 



^2t(Ao,r) 



(1,0, 



J{yt- 



a.s., 



where = (e^, . . . , u = (1, 0, . . . , O)^^! and $ is defined as in The- 
orem A.l. Following Stute [29], we call {T„(r):r S i?} a marked empirical 
process, where each yt_d-i is a marker. It is a linear marked empirical pro- 
cess and includes infinitely many markers. As stated in Section 1, this is a 
new empirical process. Let D'i[R^] = D[R^] x • • • x D[R^f] {q factors), which 
is equipped with the corresponding product Skorohod topology and in which 
= [—7,7]. Weak convergence on is defined as that on D'^lR.^f] for 



each 7G (0,00) as n^oo and is denoted by 
convergence of {T„(r) :r G R} as follows. 



We now give the weak 



Theorem 2.1. If Assumption 2.2 holds and all the roots of — YTi=i 'Pi ^ 
^p-i _ Q inside the unit circle, then under Hq it follows that 

Tn{r)^aGg{r) in D''[R], 

where {Gq{r):r G R} is a q x 1 vector Gaussian process with mean zero 
and covariance kernel Kj-s = '^rs — ^'ir'^~^'^is , o,nd almost all its paths are 
continuous. 



Unlike Koul and Stute [22], our weak convergence does not include the 
two end-points ±00 and LRn only requires the weak convergence on D''[R\. 
In addition, our technique heavily depends on R^ and Assumption 2.2. The 
covariance kernel K^s is essentially different from those of the empirical 
processes with one marker. Theorem 2.1 is a new weak convergence result 
and its proof is given in Section 5. 

Under Hq, it is well known that o"^ = cr^ + Op(l). By Lemma 2.1(c), The- 
orem 2.1 and the continuous mapping theorem, we obtain the main result 
as follows. 



Theorem 2.2. If Assumptions 2.1 and 2.2 hold, then under Hq it fol- 
lows that 

LRn^ sup \G'q{r)K-^Gq{r)] 

rG[a,fe] 

as 00, where — > stands for convergence in distribution. 
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When p = q < d, S^r = ^ir = ^Fy{f) since Zt^i and yt^d are independent. 
Here Fy[r) = P{yt < r). Thus, the hmiting distribution is the same as that 



of 



\Bp{s) 



(2.2) sup 2 ' 

where /3i = Fy{a), (32 = Fy{b) and Bp{s) is a p x 1 vector Gaussian process 
with mean zero and covariance kernel (r A s — rs)Ip, where Ip is a p x p 
identity matrix. It is interesting that this distribution is the same as that 
of test statistics for change-points in [4]. The critical values can be found in 
[4]. In practice, we can select, for example, f3i = 0.05 and P2 = 0.95. Some 
guidelines on this can be found in [8] . For given Pi and P2 > we can compute 
LRn with a = F~y{Pi) and b = F~y{f32), where F~y{T) is the r-quantile 
of the empirical distribution based on data For other cases, 

the critical values of LRn can be obtained via a simulation method. The 
implementation is not so difficult in practice. 

3. Asymptotic power under local alternatives. To investigate asymptot- 
ically the local power of consider the local alternative hypothesis 

Hin '■ tpo = —;= for a constant vector h£ R'^ and r = £ R, 

/n 



where tq is a fixed value. For this, we need some basic concepts as follows. 
Let J^^ be the Borel a-field on with Z = {0, ±1, ±2, . . .} and P be a 
probability measure on iJZ^ ,J-^). Let be the restriction of P on the 
cr-field generated by {Iq) 2/1) • • • > 2/^}) where Iq = {2/0)2/-!) • • •}• Suppose the 
errors {ei(A,ro), e2(A, ro), . . .} under Pj^ are i.i.d. with density / and are 
independent of Yq. From model (2.1), the distribution of initial value Iq is 
the same under both and Pj^^. Thus, the log-likelihood ratio A„(Ai,A2) 



of P^^ to P^^ is 



A„(Ai,A2) =2^[logsj(A2) -logst(Ai 



t=i 



where st{\) = \/ f{et{\,ro)); see [21] and [25] for details. We first introduce 
the following assumption. 

Assumption 3.1. The density / of £t is absolutely continuous with 
a. e. -derivative and finite Fisher information, < /(/) = J!^^[f'{x)/f{x)]'^ x 
f{x) dx < 00. 

The following theorem gives the LAN of A„(Ai, A2) for model (2.1) and the 
contiguity of PJ^^ and P_^q_,_„ /^) where bounded constant sequence 

in RP+'i. 
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Theorem 3.1. If Assumptions 2.1, 2.2 and 3.1 hold and Xq = {(p'^jO)', 
then: 

(a) A„(Ao, Ao + ^) = n-i/2„; ^JL^ Ut{Xo, ro)6 - /(/)<0,,„n„/2 + Op{l) 
under P^^ , and 

(b) F^^ and P^^j^^ are contiguous, 

where Ct = f i£tiXo,ro)) / f {et{Xo,ro)) and Qr is defined as in Lemma 2.1. 

Proof. By verifying the conditions in Theorem 2.1 and (2.2) in [25], 
we can show that the conclusions hold. The details are omitted. □ 

Using Theorem 2.1 and following a routine argument, we can obtain the 
following theorem. This theorem shows that LRn has nontrivial local power 
under Hin- 

Theorem 3.2. If Assumptions 2.1, 2.2 and 3.1 hold, then under Hin- 

(a) Tn{r) ^ ^x{r) + aGq{r) in D'i[R], and 

(b) LRn^ sup {[cT^V(r)+G,(r)]%-i[a^V(0+Gg(r)]}, 

re[a,6] 

where ^{r) = Rrrgh and Gq{r) is a Gaussian process defined as in Theorem 
2.1. 

4. Simulation and one real example. This section first examines the 
performance of the statistic LRn in finite samples through Monte Carlo 
experiments. In the experiments, sample sizes (n) are 200 and 400 and 
the number of replications is 1000. The null is the MA(1) model with 
010 = —0.5 and 0.5 and the alternative is the TMA(1, 1,2) model with d = 2, 
ro = 0, (pio = 0.5 and V'lo = -0.5, -0.3, -0.1, 0.1, 0.3, 0.5. We take (3i = 0.1 
and (32 = 0.9 in LRn- Significance levels are a = 0.05 and 0.1. The corre- 
sponding critical values are 7.63 and 9.31, respectively, which were given 
by Andrews [4]. The results are summarized in Table 1. It shows that the 
sizes are very close to the nominal values 0.05 and 0.1, in particular, when 
n = 400, and the power increases when the alternative departs from the null 
model or when the sample size increases. These results indicate that the test 
has good performance and should be useful in practice. 

We next analyze the exchange rate of the Japanese yen against the USA 
dollar. Monthly data from Jan. 1971 to Dec. 2000 are used and have 360 
observations. Define xt = 100 A log (exchange rate) at the tth month and 
yt = xt- J2t=i xt/3m. AR(1), TAR(1, 1, 1), MA(1) and TMA(1, 1, 1) mod- 
els are used to fit the data {yi, . . . , yseo}) where the TAR(1,1,1) model is 
defined as in [8]. The results are summarized in Table 2, where Q{M) is 
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the standard Ljung-Box statistic for testing the adequacy of models fitted 
and ro is estimated by argmin,.g/jLi„(A(r),r). The table shows that Q(ll), 
Q(13) and (5(15) all reject AR(1) and TAR(1, 1, 1) models, but they do not 
reject the MA(1) or TMA(1,1,1) models at significance level 0.05. 

Based on the MA(1) model, the statistic LRn is calculated with (3i = 0.1 
and = 0.9 and its value is 14.19. Furthermore, we use the residuals and 
the estimated (pio in the MA(1) model to estimate the asymptotic covariance 
matrix in Theorem 2.2. Using these and the simulation method with 25,000 
replications, we obtain that the critical values of the null limiting distribution 
of LRn are 6.995, 7.483 and 10.831 at significance levels 0.10, 0.05 and 0.01, 
respectively. This shows that the null hypothesis of no threshold in the 
MA(1) model is rejected at all these levels. Furthermore, we note that the 

Table 1 

Size and power of LRn for testing threshold in 
MA(1) models (i3i=0.1, /?2 = 0.9, d = 2, 
1000 replications) 



a 


n 


= 200 


n = 


400 


5% 


10% 


5% 


10% 


l/>10 




Sizes 






-0.5 


0.044 


0.097 


0.058 


0.102 


0.5 


0.059 


0.112 


0.051 


0.101 


^10 




Powers when </ 


ho =0.5 




-0.5 


0.836 


0.909 


0.993 


0.999 


-0.3 


0.318 


0.514 


0.710 


0.815 


-0.1 


0.076 


0.156 


0.123 


0.191 


0.1 


0.103 


0.167 


0.143 


0.237 


0.3 


0.599 


0.717 


0.916 


0.953 


0.5 


0.989 


0.993 


1.000 


1.000 



Table 2 

Results for monthly exachange rate data of Japanese yen against USA dollar (^1971 to 

2ooo; 





000 IpOO 


4>io 


■4>io 


ro 


Q(ll) 


Q(13) 


Q(15) 


AIC 


AR(1) 




0.345 






22.66 


28.91 


29.26 


699.83 


TAR(1, 1, 1) 


0.930 -0.905 


0.076 


0.293 


-2.51 


20.97 


28.40 


28.63 


704.44 


MA(1) 




0.402 






13.59 


18.93 


19.36 


693.17 


TMA(1,1,1) 




0.281 


0.445 


-4.93 


15.52 


19.52 


19.73 


691.61 



Upper-tail 5% critical values; Q(ll) = 19.68, Q(13) = 23.36 and Q(15) = 25.00. 
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TMA (1,1,1) model achieves the minimum AIC among the four candidate 
models and, hence, it should be a reasonable choice for the data. 

Finally, to understand what order of AR or TAR model is adequate for 
the data, some higher-order models are fitted. We found that AR(2) is not 
adequate, but AR(3) and TAR(2, 2, 1) are adequate at significance level 0.05. 
The result for AR(3) is yt = 0.390yt_i - 0.139yt-2 + 0.103yj_3 + et, for which 
Q(ll) = 13.211, Q(13) = 18.106 and (5(15) = 18.573 and the value of AIC 
is 696.50. The result for TAR(2, 2, 1) is yt = 0.821 + 0.130yi_i - 0.0822/t_2 + 
[-0.790 + 0.275yj_i - 0.018yj_2]/(yt-i < -3.741) + et, for which Q(ll) = 
12.214, Q(13) = 16.936 and Q(15) = 17.325 and the value of AIC is 705.08. 
In terms of AIC, it is clear that not only are AR(3) and TAR(2,2, 1) worse 
than TMA(1, 1, 1), they are also worse than MA(1). 

5. Proof of Theorem 2.1. To prove Theorem 2.1, we first introduce three 
lemmas. Lemma 5.1 is the basis for the other two lemmas and is similar to 
Lemma A.l in [18]. 

Lemma 5.1. If Assumption 2.2 holds, then under Hq it follows that 

(a) E[\et-j\^I{r' <yt.d<r)]<C\r - r') as A: = 0, 1, 2, 3, 4, andj>l, 
and 

(b) EmJl < C(r - r') as A; = 1, 2, 3, 4, 

where mt = ||.^f_i||/(r' < yt-d < r), r' < r, r,r' G i?^, is defined in Sec- 
tion 2, and C is a constant independent of r' and r. 

Proof. Since E\et^j\'^ < oo, there is a constant M such that sup|^.|>j,^ x 
f{x) < 1. Since / is continuous, it follows that sup|2,|<^ \x\^f{x) < oo. Thus, 
sup3,g^ |x|''/(2;) < cx) for A; = 0, 1,2,3,4. Let gt = X]f=i 4>io£t-i- When j ^ d, 
E[\et-j\''I{r' < yt_d < r)] = E[\et^j\'' jyjgll'Jix) dx] < C(r - r'). When 

j = d, E[\Et-d\''I{r' < yt-d < r)] = E[flr_%-_'^ \x\''f{x) dx] < C{r - r'). Thus, 
we can show that (a) and (b) hold. □ 



Lemma 5.2. Under the assumptions of Theorem 2.1 and Hq, it follows 
that: 

4 



E 



(a) 



1 



E 

t=i 



"^u^'uZt-i-iI{r' < yt-d-i < 
i=0 



<c 



ir — r 



n 



+ (r - r') 



and 



10 



S. LING AND H. TONG 



(b) E 



V ^ t=l i=o 



<C 



ir — r 



n 



+ (r - r') 



where C is a constant independent of r' , r and n, and mt is defined in 
Lemma 5.1. 



Proof, (a) Let atj = et-i-jl{r' < yt~d-i < r), where i > and j = 
1, . . . Since £t and atj are independent and atj is {p + q + d) -dependent, 
we can show that E{Y2=iatjet)'^ < 0{l)YJl=iYJl^=iE{alja\je1e\), where 
0(1) holds uniformly in i. Note that ||<I>^|| = 0(p*) with p € (0, 1). Thus, by 
Minkowskii's inequality, 



E 



—y 



i=l 
1 



i=0 



E 



^u'^'uZt-i^iI{r' < vt-d-i < 
=0 

oo n 

^n'$^^z^[Zt„i„i/(r' < yt^d^i < r)]£t 



(5.1) 



i=Q t=l 



< 



i=0 

oo 

i=0 



E 



J2[Zt-i-iI{r' <yt-d~^<r)]et 



t=i 



1/4 N 4 



Eij2ml,el 



4 



1=0 



i=l 



where the third and the last steps hold using the inequality (X^i^o /'''^«)^ 

E^o E,°lo P'^'<^^<^3 < (1 - E£o for any G as E£o < ^o- 
By Lemma 5.1(b), 



-I n 1 " 



n 



£=1 



n 



t=i 



< 2E 



t=i 



t-i 



i=l 
n 



^ E EmUE{e] - Ee^f + 2{EeU?E - E 



i=l 



<^^^ + 2(i..L)^i. if..?. 
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where Cq is a constant independent of i, r' , r and n. Again, by Lemma 
5.1(b), 



1 



E 



t=i 



l" t=l 



m 



t-i 



Emf_i) + Em 



2 

t~i 





fl 








H 




n 





.t=i 



1/2 



+ C{r - r') 



Since yt is only p-dependent, we see that nit is p-dependent, where p = 
p + q + d. So, E[{mf — Emf){mf_^ — Em^J] = when |t — ti| > p. Thus, by 
Lemma 5.1(b), it follows that 



,t=l 



E[ Y^imU-Eml 

Y.E{mU - Emlf + 2^ 5]i?[(m2„, - i?m?_J(m?„,+, - Eml,)] 
t=i 

n 

-Y^EimU-Eml 



n n—t 



t=l s=l 



t=l 



n m'm{n~t,p} 

+ 2E E E[iml,-Eml,)iml,^,-Eml,)] 

t=l s=l 

n 

< (2p + l)Y,E{mli - Emtif < {2p + l)nC{r - r'), 
t=i 

where C is a constant independent of i, r' , r and n. By the preceding three 
equations and (5.1), we can claim that (a) holds. 

(b) Let et = \et\ — E\et\. As for (5.1) and the preceeding argument, we 
have 



E 



n oo 
V ^ t=l i=o 

0(1) 



71 n / OO 



EE Eii-^IK- 

t=l ti=l \ i=0 



Ell^il"^ii-* ) e?^' 

, i=0 



2-2 

ti 



t=l\i=0 / 



< C 



n 



where C is a constant independent of i, r' , r and n. Thus, (b) holds. □ 
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Lemma 5.3. Under the assumptions of Theorem 2.1 and Hq, it follows 
that 



E 



1 



n 4 



t=\ i=0 



<C 



r — r 



n 



t\2 



+ (r — r') 



where C is a constant independent of r' , r and n, and rut is defined in 
Lemma 5.1. 



Proof. First, for any integer i > 0, we have the inequahty 

-|4 

E ^{mt-i-Emt) 

n n—t 



t=l 



<Y,E{mt_i-Emtf + ci 



(5.2) 



t=i 



+ C2 



+ C3 



^ ^ E[{mt-i - Emtf {mt+s-i - Emt)] 



t=l s=l 



n n—t 

^ ^ E[{mt-i - Emtf {mt+s-i - Emtf] 

t=l s=l 
n n—t n—t—ti n—t—ti—t2 

EE E E E[imt-^-Emt) 

t=lti=l t2 = l tz = l 

X {mt+ti-i - Emt 



Emt 



't2+t-j,-i 



Emt)] 



Ain + CiA2n + C2^3n + C3A 



An: 



where ci,C2 and C3 are constants independent of n and i. Since mt is p- 
dependent, -E'[(mt — Emt)^{mt^ — Emt)] = when |t — ti| > p, where p = 
p + q + d. Thus, by Lemma 5.1(b), 

n min{n-t,p} 

^2n=E E E[{mt^i- Emt)''^{mt+s-i- Emt+s) 

t=l s=l 

< npE{mt-i — Emt)"^ 

< npCi{r — r'). 

Let fht = {mt_i — Emt)"^ — E{mt-i — Emt)"^. Then, by Lemma 5.1(b) we can 
show that Emt 1^C2{r — r'). Since {fht} is a p-dependent sequence, we know 
that E{mtirit^) = when \t — ti\ > p. Furthermore, by Lemma 5.1(b), 



I3n 



n n—t 



E{mtmt+s) - E("' ~ t)[Ei'mt - Emt) 



2i2 



t=l s=l 



t=l 
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< 



n mm{n-t,p} 

J2 J2 E{mtmt+s) 

t=l s=l 



+ C^'n?'{r — r 



/\2 



< C2pn{r — r') + C^n'^{r 



Denote pi = min{n — Similarly, by Lemma 5.1(b) we have that 

^4n 



n pi pi-tipi-ti-t2 

EE E E E[imt-i-Emt) 

t=l ti=l t2=l t3 = l 



+t2-i 



Errif 



<pI^ E{mt-i - Emt 



t=i 

< np'fC4{r — r'). 

By Lemma 5.1(b), the preceding three inequalities and (5.2), we can claim 
that 

n4 



E 



^{mt-i - Emt) 



t=i 



< nC^ir - r') + C^n^r - r') 



l\2 



In the above, Cj, i = 1, . . . , 5, are some constants independent of r', r, i and n. 
By the assumption given, = 0{p^) with p € (0, 1). Thus, by Minkowskii's 
inequality, 

1 4 

E 



1 n oo 

-7=EEii^iiK--^"^*-^ 

V ^ t=i i=o 



Eii'^^ 



1=0 



^{mt-i - Em- 



t—i I 



< 



< 



0(1) 



i=0 



^{mt-i - Emt-i) 



t=i 



4s 1/4- 



^1 [nC5(r - /) + C,n\r - rOY^' E/'^} 



n 



where C is some constant independent of r', r and n. □ 
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Proof of Theorem 2.1. We use Lemmas 5.2 and 5.3 to prove the 
tightness. Let 



1 



E 



J2u'^'uZt-^-lIiyt-d-i < r) 



t=l li=0 



We first show that {Ti.„(r) :r G R^} is tight. For any given > 0, we choose 
((5, n) such that 1 > 5 > n"-*^ and ^/n > M/?? and then choose an integer K 
such that 5n/2 < K < n6, where M is determined later. 

Let rfc_|_i = Tfc + 5/K, where ri = r' and k = 1, . . . ,K . Thus, 



(5.3) 



sup ||ri„(r)-Ti„(r')|| 

r' <r<.r' +5 

< sup \\Tinirk) - Tinir')\\ 
l<k<K 

+ sup sup ||Ti„(r) - Ti„(rfc)||. 

l<k<Krk<r<rk+S/K 



For any I < i < j < K, we have {rj - ri^^"^ = [{j - i)6/K]'^^'^ < {j - 
i)\fEjK. By Lemma 5.2(a) and the inequahty \l\fn< \/5/K , it fohows 
that 



E\\Tin{ri)-Tin{rj)t<C 



+ {rj-ri) 



n 



4t{ 



, k=i+l 



Note that Ti„(rj) - Tin{ri) = Ei=i+i[^in(?^fc) - 7in(rfe_i)]. By the preced- 
ing equation and Theorem 12.2 of [5], page 94, there exists a constant Ci 
independent of K, 5, r' and n such that 

2 



(5.4) 



Pi sup ||ri„(rfc)-ri,(r')||>:^ < 



i<fe<is: 



E 

fc=i 



We now consider the second term of the right-hand side in (5.3). Let 
rukt = \\Zt-i\\I{rk < yt-d <rk + S/K). 
By Lemma 5.1(b) and the definition of K and r], 



E\et\ 



E^E 11^1 



rrikt- 



t=i 



, j=o 



< 



< 



K 

2C2y/n5_ 

n5 
2C2 ^r? 



n 
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independent of k, 6, r' and n. By the 
Markov's inequality, 



as M > I6C2, where C2 is a constant independent of k, 6, 
ceding inequahty, Lemma 5.3 and Markov's inequahty, 



as M > I6C2, where C2 is a constant 
preceding inequahty, Lemma 5.3 and 

A' / 1 n r 00 
k=l \V'^t=iL »=o 



K 

<E^| 

k=l 



' PI I n r / 00 \ / 00 

J^E[(gi,.-iK,)-.(gi,.-iK, 



' fc=i 



-j^ n 00 

""""||$'||(mfct-^mfct 



i=0 
4 



< 



5' 



< 



2C7452 



- ^4 



< (5/iir, where C3 and C4 are constants independent of K, 6, r' 
By the preceding inequahty. Lemma 5.2(b) and Markov's inequahty, 
e 



(5.5) 



sup sup \\Tin{r) - ri„,(rfc)|| > ^ ) 

^l<k<Krk<r<rk+S/K ^1 
K f ^ n T 00 

(\et\- E\et\)Y^\\^'\\mkt 



K ( . n 



j=0 



+ 



44 ^ 



00 

{E\et\)Y.W\\mu 

i=0 



^E(i^*i-^i^*i)Eii'^ii-^* +—! 

^ 2C452 (2C4 + 4C5)52 



^4 



since 



4 — 4 ' 

< where C5 is a constant independent of K, 5, r' and n. 

Given e > and ry > 0, let 5 = min{er/V(2C4 + 4C5 + CCi), 0.5}. We first 
select M such that M > I6C2, and then select N = max{(5-^ M^/r/^}. Thus, 
for any r' £ R^, as n> N, by (5.3)-(5.5) it follows that 

sup \\Tin{r)-Tin{r)\\>ri]< \ j—<de. 



P 



\ r'<r<r'+(5 



^4 
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By Theorem 15.5 in [5] (also see the proof of Theorem 16.1 in [5]), we can 
claim that {Tin{r):R^} is tight. Furthermore, since J2t=i ^ui^o^f)/ is 
tight under Hq and Si^ is continuous in terms of r on R^, we know that 
{Tn{r) : R^} is tight. We can show that the finite-dimensional distributions of 
{T„(r) : r £ R^} converge weakly to those of {aGq{r) : r G i?^}. By Prohorov's 
theorem in [5], page 37, T„,(r) =^ aGq{r) on D'^[R^] for each 7 G (0,oo). By 
Theorem 15.5 in [5], almost all the paths of Gq{r) are continuous in terms 
of r. □ 

6. Proof of Lemma 2.1. To prove Lemma 2.1, we need six lemmas. 
Lemma 6.1 is a basic result. Lemmas 6.3 and 6.4 are for Lemma 2.1(a). 
Lemmas 6.2 and 6.5 are for Lemma 2.1(b). Lemma 6.6 shows that the ef- 
fect of initial values is asymptotically ignorable. Most of the results in this 
section still hold under Hi. 

Lemma 6.1. If Assumption 2.1 holds with Eef < 00, then under Hq: 
(a) E'sup sup e^(A,r)<oo, 

61 m[a,b] 



(b) E'sup sup 

61 re[a,b] 

(c) E'sup sup 

01 re[a,fe] 



det{X,r) 



dX 



< 00, 



dXdX 



—^t{X,r) 



< 00. 



Proof. By Theorem A. 2 in the Appendix, under Hq the following ex- 
pansion holds: 



a.s., 



(6.1) et{X, r)=yt + J2u'Y[[^ + ^/(yt-d-i+i < r)]uyt.j 
j=i i=i 

where u, ^ and ^ are defined in Theorem A. 2. By (6.1) and Theorem A.l, 
we have 



(6.2) 



sup sup \et{X,r)\ <0{l)^p'\yt- 

Bi re[a,b] 



a.s., 



1=0 



where p G (0,1). Since Eej < 00, it is readily shown that Ey^ < 00. By 
Minkowskii's inequality, we can show that Esupe^ sup^g[a (A, r) < 00. 
Thus, (a) holds: 



detiX,r) 
det{X,r) 



-et^k{X, r) -^[(t)i + ipil{yt-d < r)] 



det-i{X,r) 



P 



-eu-i{X,r) -Y^[cl)i + ipil{yt-d<r)] 



i=l 



det^i{X,r) 



TESTING FOR MA AGAINST TMA MODELS 



17 



where eit^i{X,r) = et^i{X,r)I{yt-d < r), k = l,...,p and l = l,...,q. By 
Theorem A. 2, under Hq, the following expansions hold: 

dst{X,r) 



(6.3) ^-^^ ^ 

j=i 1=1 



d£t{X,r) 



(6.4) 



-£it-i{X,r) - 5I^'n[^ + "^liVt-d-i+i < r)]ueit-i-j{X,r), 
j=i i=i 



a.s. Using (6.3) and (6.4), Theorem A.l and a similar method as for (a), we 
can show that (b) holds. Similarly, we can show that (c) holds. □ 

Lemma 6.2. // Assumptions 2.1 and 2.2 hold, then under Hq 0^ is 
positive definite for each A G 0i. 



Proof. It is sufficient to show that if 
E 



^, det{X,r) det{X,r) ^ 



dX dX' 



0, 



then c = for any constant vector c = (01,02)' with ci = (cn, . . . , oip)' and 
02 = (c2i, • • ■ ,C2g)'- The above equation holds if and only if 0' det{X,r)/dX = 
a.s., from which we can show that 



Li=l 



"^OuEt-iiX, 



Hvt-d > r) 



+ 



^{cii + 02i)et-iiX,', 



Li=l 



Hyt~d<r) = a.s., 



where 02i =0 as i > q. From this equation, we have that 

p 



(6.5) 
(6.6) 



^oiiet-i{X,r) 
1=1 

^(cii + 02i)et-i{X,r) 



i=l 



I{yt-d > r) = a.s. 
I{yt-d < r) = a.s. 



Denote the event A = {X^iLi ciiej_i(A, r) = 0}. If cn / 0, for simplicity let 
cii = 1. Then A = {et-i{X,r) = - EiL2 cijet-i(A, r)}. Let git^i{X,r) = 
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YH=i[(t>i + '^iI{yt^d-i <r)]£t-i-i{\,r) and5f„2 = 5it~i(A, r) -X;-Li ^ioEi-i - 
Er=2 ciiet-i{\,r): 

V 

1=1 

and, hence, A = {et-i = gt-2}- Since et~i and are independent and £t 
has a density function, P{A) =EI{et-i = gt-2) = E{E[I{£t-i = gt-2)\gt-2]} = 
0. Thus, 



P 



^ciiej_i(A,i 



Li=l 



P 



I{yt-d > r) = 



^ciie4_i(A,i 



j=i 



I{yt-d >r) = 0}nA' 



P{{I{yt-d > r) = 0} n A^) = P{{I{yt-d >r) = 0}) 



P Et-d <r-Y (t>io£t~ 



i=l 



f{x) dx}>0 



since / is positive, where / is the density of et- This contradicts (6.5). So, 
cii = 0. Similarly, we can show that C12 = • • • = cip = 0. Similarly, we can 
show that C21 = • • • = C2q using (6.6). □ 

Lemma 6.3. If Assumptions 2.1 and 2.2 hold, then under Hq, 
inf inf E[ef{X,r)—ef{Xo,r)]>0 foranyr]>0. 

||A-Ao||>-/yrG[a,fe] 

Proof. Let Vt^i{X,r) = et{X,r) - et{Xo,r). Then 



Vt-i{X,r) = Yii't'i - (t>io) + {ipi - ipio)I{yt-d < r)]et-i{X,r) 



(6.7) 



+ ^[('^^0 + i^io)I{yt-d < r)]T4_,(A,r) 



and, hence, it is independent of et- Note that, under Hq, et(Ao, r) = et- Since 
et{X,r) =et{Xo,r) + Vt-i{X,r),wehaye Ee^t{X,r) = Ee^{Xo,r) + EVtl^{X,r). 
EVl^_i{X,r) = if and only if Vj_i(A,r) = a.s. By (6.7) this occurs if and 
only if - (Pio) + {ipi - tpio)I{yt~d < r)]ej_i(A,r) = a.s. From the 

proof of Lemma 6.2, the preceding equation holds if and only if A = Aq 
for each r G [a,b]. Since EV^^_i{X,r) is a continuous function of (A',r) and 
01 X [a,b] is compact, we have iy^i{\\x-XQ\\>Tj}x[a,b] -E'^-i(A,r") > 0. Thus, the 
conclusion holds. □ 
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Lemma 6.4. If Assumptions 2.1 and 2.2 hold, then under Hq, for any 
e>0, 



lim P \ — sup sup 



Y.[el{Kr) - Eel{\,r)] 



i=l 



>£ =0. 



Proof. Since 0i is compact, we can choose a collection of balls of radius 
5 > covering 0i and the number of such balls is a finite integer Ki . We take 
a point Aj in the ith ball and denote this ball by . Similarly, we divide [a, h] 
into K2 parts such that a = ri < r2 < ■ ■ ■ < rK2+i = ^ with |rj — rj_i| < 5. 
Thus, 



P ( — sup sup 

\" 01 r6[a,fe] 



^[e?(A,r)-i?4(A,r)] 



t=i 



> e 



5;|e?(A,.r,)-Ee?(A„r^)] 



t = l 



i=lj=l 

+ P( sup sup sup sup \E[ef{Xi,rj)—ef{X,r)]\>^ 

\l<i<Ki l<j<K2 Ae^Ai ^j<^'<rj+i 

+ P ( — sup sup sup sup 

\n l<i<Ki l<i<A'2 AsVa. rj<r<rj+i 



^[e?(A,r)-£?(A„r,)] 



i=l 



> 



= Bin + B2n + Bsn, Say. 
For any r' < r, let = -ELi < l/t-d < r)et-i{X, r'). By Theorem A.2, 

00 j 

et(A,r) -et(A,r') = Xt + ^n'P][$ + ^'/(yi_rf_i+i <r)]nXt_j a.s. 

j=i i=i 

By Lemma 5.1(a), we know that EI{r' < yt^d ^ r' + 6) = 0(6). Furthermore, 
by Lemma 6.1(a) and Holder's inequality, we can show that 

^ sup sup sup X^ = 0{6^^^). 

AG01 r'<^[a,b]r'<r<r'+5 

By the preceding two equations. Theorem A.l and Minkowskii's inequality, 
we have 

/ 00 \ 2 

^sup sup sup |et(A,r)-ej(A,r,)|2<0(l)K]/?Mi/M =0(5^/2)^ 

\eeil<j<K2rj<r<rj+i J 

By this equation. Lemma 6.1(a) and the Cauchy-Schwarz inequality, 
(6.8) ^sup sup sup \ef{X,r) -ef{X,rj)\ = 0{6^/'^). 

Ag6i l<i<A'2 rj <r<rj+i 
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By Taylor's expansion and Lemma 6.1(b), we have 
E sup sup sup \et{X,r)— et{\i,r)\'^ < 6"^ E sup sup 

l<i<Ki XeVx- r&[a,b] 0ir6[a,fe] 



detiX,r) 



dX 



Furthermore, by Lemma 6.1(a) and the Cauchy-Schwarz inequaUty, we can 
show that 



(6.9) 



E sup sup sup \ef{X,r) — ef{Xi,r)\=0{6). 

l<i<Ki XeVx. re[a,fe] 



By (6.8) and (6.9), we can take 6 small enough such that i?2n = and 



/ 1 

-Bsn < -P — sup sup sup 

\n l<i<Ki XeVx. rG[a,fe] 



1 



t=i 



> 



+ P \ — sup sup sup 

ylT' AeBi l<j<K2rj<r<rj+i 



5:[e?(A,r)-e?(A,. 



t=i 



e \ £ 
> - < -. 



For this (5, Ki and K2 are fixed. By the ergodic theorem. Bin < e/3 for n 
large enough. Thus, we can claim that the conclusion holds. □ 

Lemma 6.5. If Assumptions 2.1 and 2.2 hold, then under Hq, for any 
e > 0, there is an r] > such that 



pi — sup sup 

V'^ |jA-Ao||<r? re[a,fe] 



J2[PtiX,r)-nr 



t=l 



> e ] < e, 



where Pt{X, r) = Ut{X, r)U[{X, r) + [^^^^(A, r) / dXdX!]et{X, r) . 

Proof. As for Lemma 6.4, the conclusion can be proved by using Lem- 
ma 6.1. □ 



Lemma 6.6. If Assumptions 2.1 and 2.2 hold, then under Hq: 



(a) — sup sup 

61 re[a,6] 

(b) —= sup sup 



t=l 



(c) — sup sup 

01 r6[a,b] 



^[e?(A,r)-e1(A,r 
1 

n 

^[A(A,r)-A(A,r)] 
t=i 

Y,[Pt{X,r)-m,r)] 



Op(l)> 



Op(l), 



t=i 



Op(l), 



where Pt{X,r) is defined in Lemma 6.5 and typically Dt{X,r) is Dt{X,r) with 
the initial values ys = for s < 0. 
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Proof. By Lemma 6.1 and Theorem A.l we can show that the conclu- 
sion holds. □ 

Proof of Lemma 2.1. For any i] > 0, let c = mf^\x-Xo\\>v ''^'^^r€[a,b] E[ef{X, 
r) — e^{Xo,r)]. By Lemma 6.3 c > 0. Furthermore, by Lemma 6.4 we have 
that 



pi inf , inf \Y,[eKX,r)-eUXo,r)] 

\rela,b] ||A-Aoj|>r; 



cn 

Y 



<0 



P inf inf \y\e^(X,r)- Eef(X,r)] 



>t=l 



J2[e',{Xo,r)-Ee',{Xo,r)] 



t=i 



cn 



+ n[EEtiX,r)-EetiXo,r)]-- \ <0 



< P sup sup< 

Vre[a,6] 01 I 



1 " 

-Y^[e',{X,r)-EeUX,r)] 



> 



as n — > oo. Using the preceding equation and Lemma 6.6(a), we can show 
that 



pi inf^,, inf 5:[e1(A,r)-e1(Ao,r)] 

\rela,b] ||A-Ao!|>»; 

as n — > oo. Thus, for any e > 0, it follows that 



cn 
T 



<0 ^0 



P( sup ||A„(r)-Ao|| >e 

.r6[a,6] 



P\ fXnir) - Aoll > e,5:[e1(A„(r),r) - £l(Ao,r)] < 0, 

for some r € [a, 6] 



<P inf inf E[e1(A, r) - e1(Ao, r)] < ^ 

[r6[a,6]|jA-Ao||>e^^ J 

as n ^ oo, that is, (a) holds. Using Taylor's expansion, by (a) of this lemma, 
Lemmas 6.2, 6.5 and 6.6(b)-(c), we can show that (b) holds. For (c), let 
D,n = n-'/^j:t=iDit{Xo,r) and = n'^/^ ^JLi ^2t(Ao,r). Lo„(<^„) has 
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the expansion 

(6.10) 2[Zo„(<^„) - Lon(</'o)] = -D[j:~^Din + Op(l). 

By (b) of this lemma and Lemmas 6.5 and 6.6, using Taylor's expansion, it 
follows that 

2[Zi„(A„(r), r) - Li„(Ao, r)] = -D'^^-^Dn + i?n, 

where Dn = and sup^gj^ j,] \Rn\ = Op(l). After some algebra we 

have 

2[Li„(A„(r),r) - Li„(Ao,r)] = -r;(r)ir-ir„(r) - L>;„S-iZ)i„ + 

Since Lon(0o) = -^inl-^O) ''') under i^o for each r, by (6.10) and (6.11), (c) 
holds. □ 

APPENDIX 

Invertibility of TMA models. This appendix gives a general invertible 
expansion of TMA models, which can be used for TARMA models. We first 
provide a uniform bound for these coefficients. 

Theorem A.l. If Assumption 2.1 holds, ^/len supQ^ sup^g^ || ni=i[^ + 
^'/(yj_j < r)] II = 0(/>') a.s., as j —> 00, u;/iere p € (0, 1), 

wzi/i Jfc being the k x k identity matrix and Okxs the k x s zero matrix. 



Proof. Let o = supe^ max{X;f=i l-^il^ELi l<^i + V'ill- Then a G [0, 1]. 
Since 0i is compact, if a = 1, then there exists a point A £ Oi such that 
Z]?=i I'/'il = 1 o'^ X^iLi |</'i + V'il = 1) which contradicts Assumption 2.1. Thus, 
a G [0, 1). For any matrix C = (cjj), we introduce the notation |C| = (|cjj|). 
Denote ei = (0, . . . , 0, 1, 0, . . . , 0)pxi with the zth element equal to 1, and 
f = (l,..., 1)^x1- Thus, 



sup 

r&R 



ej\[[^ + ^I{yt^i<r)]ek 
1=1 

n 

< supej J][|$|/(yj„i > r) + 1$ + '^\I{yt^i < r)]v 

< max< ej Y\_AiV.Ai = \^\ or |$ + ^| > a.s.. 



i=l 
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for any j,k = l,...,p. It is not difficult to see tliat AnV < (a, 1, . . . , 1)', 
where, for two vectors B = (bi, . . . , bp)' and C = (ci, . . . , Cp)' , B < C means 
that hi < Ci for i = 1, . . . ,p. Since a E [0, 1), we can see that An-iAnV < 
^„_i(a, < (a,a,l,...,l)',..., and An-p+i...AnV < {a,a,...,a)' = 

av. Let n = ps + r, where r = 0, 1, . . . ,p — 1. Then sup0^ ej HiLi — Ca^, 
where C > is a constant independent of n. Since a** = 
the conclusion holds. □ 



Theorem A. 2. Let {{wt,yt) '-t ^ Z} be a strictly stationary sequence 
with E\wt\ < oo. If Assumption 2.1 holds, then there exists a unique strictly 
stationary solution {zt} to the equation zt = Wt — Y^\=i 'i^i^t-i — J2i=i ipilivt-d < 
r)zt-i, with p>q, and zt has the expansion 

oo 3 

zt = wt + ^u'\{[^ + ^I{yt-^d~i+i < r)]uwt-j, 
j=i i=i 

a.s. and in , where <I> and ^' are defined as in Theorem A.l and u = 
(1,0,...,0)' 1. 



Proof. Let Ct = (^t, • • • , ^i-p+i)', A 
We can rewrite zt in the vector form 



$ + -^I{yt-d < r) and Yt = uwf 



(A.l) 



t-\- 



We iterate this equation J steps: Ci = + J2j=i I\ 



At 



By Theorem A.l it 



ULiAt-i+iCt-j- Let Sj 
is not hard to see that 



t-j- 



(A.2) 



J2-1 j 

E\\Sj,-Sj,\\=E At-,+iYt.j 

j=Ji i=l 

J2-I 

<0{l)E\wt\ J2 P^ = 0{p''') 
j=Ji 



for any Ji < J2. By (A.2) we can show that Sj Soo a.s. and in L^. Let 
Ct = 5*00- Then Q is a solution of (A.l). To see the uniqueness, suppose that 
there is another solution Q a.s. and in for model (A.l). Let Vt = Q — Ct ■ 
Vt = AtVt-i = ••• = Yli^iAt-i+iVt-j. Since E\\Vt\\ =a constant < 00, by 
Theorem A.l we can see that -Ejl Vt|| = and, hence, Ct = Q ^-S- ^ind in L^. 
□ 
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